Skip to content
This repository has been archived by the owner on Nov 1, 2023. It is now read-only.

update the ado logic to consume the list of existing items once #3014

Merged
merged 18 commits into from
Apr 19, 2023

Conversation

chkeita
Copy link
Contributor

@chkeita chkeita commented Apr 11, 2023

Summary of the Pull Request

This change updates the logic of how we consume the list of matching work items from the server.
We used to load all work items in memory before processing them. This could potentially create memory pressure if a lot of items matched. We now consume them in batches.

A new endpoint /api/notification/tests to simplify the testing of notification has been added.
it can be access via the command onefuzz debug notification test_template <task_id> <notification_config>

closes #3038

@chkeita chkeita requested a review from tevoinea April 12, 2023 01:18
@chkeita chkeita linked an issue Apr 12, 2023 that may be closed by this pull request
3 tasks
@codecov-commenter
Copy link

codecov-commenter commented Apr 12, 2023

Codecov Report

Merging #3014 (75f5ccf) into main (256f261) will increase coverage by 0.61%.
The diff coverage is 9.17%.

@@            Coverage Diff             @@
##             main    #3014      +/-   ##
==========================================
+ Coverage   29.42%   30.03%   +0.61%     
==========================================
  Files         305      275      -30     
  Lines       36550    30963    -5587     
==========================================
- Hits        10755     9301    -1454     
+ Misses      25795    21662    -4133     
Impacted Files Coverage Δ
...c/ApiService/ApiService/Functions/Notifications.cs 0.00% <0.00%> (ø)
...iService/ApiService/Functions/NotificationsTest.cs 0.00% <0.00%> (ø)
src/ApiService/ApiService/OneFuzzTypes/Requests.cs 62.00% <0.00%> (-1.01%) ⬇️
...rc/ApiService/ApiService/OneFuzzTypes/Responses.cs 73.24% <0.00%> (-1.43%) ⬇️
...ce/ApiService/onefuzzlib/NotificationOperations.cs 27.27% <0.00%> (-1.03%) ⬇️
src/ApiService/ApiService/onefuzzlib/Secrets.cs 13.11% <0.00%> (ø)
...Service/ApiService/onefuzzlib/notifications/Ado.cs 0.00% <0.00%> (ø)
...piService/onefuzzlib/notifications/GithubIssues.cs 0.00% <0.00%> (ø)
...rvice/ApiService/onefuzzlib/notifications/Teams.cs 0.00% <0.00%> (ø)
src/ApiService/ApiService/onefuzzlib/Reports.cs 56.36% <50.00%> (-8.09%) ⬇️
... and 1 more

... and 53 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@chkeita chkeita marked this pull request as ready for review April 18, 2023 16:12
@chkeita chkeita requested a review from tevoinea April 18, 2023 16:18
@chkeita chkeita enabled auto-merge (squash) April 19, 2023 17:48
@chkeita chkeita disabled auto-merge April 19, 2023 17:48
@chkeita chkeita merged commit aa28550 into microsoft:main Apr 19, 2023
@AdamL-Microsoft AdamL-Microsoft mentioned this pull request May 4, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Process Work Items in a streaming fashion Lower maximum possible memory usage in Ado.cs
4 participants